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DETAILED ACTION 

Response to Arguments 

1. Applicant's arguments filed 11/12/2009 have been fully considered but they are 
not persuasive. 

2. Re claims 1 and 10, the Applicant contends that the prior art cited fails to teach 
or suggest that the encoding scheme for encoding a bitstream is selected by reference 
to an encoding scheme found during decoding another bitstream, i.e. skipping the third 
encoding scheme that consumes greater memory bandwidth of a shared memory. 
However, the Examiner respectfully disagrees. The Examiner explained the 
relationship between PAL and NTSC signals, corresponding to the first and second 
bitstreams, in the previous office action. Additionally, both PAL and NTSC allow for the 
use of three encoding schemes: I-, P-, and B-pictures. B-pictures are the most 
computationally intensive of the three types since they rely on multiple reference 
pictures, which must be accessed from memory. Diaz states that the decoder may 
need to drop frames (pictures) to reduce the minimum required bandwidth and still 
operate in real time (Diaz: column 3, lines 26-28), but does not specifically state that the 
dropped frames are B-frames. However, Miyawaki discloses prioritizing frames based 
on memory access constraints (Miyawaki: column 3, lines 8-15) and that B-picture skip 
may be performed (Miyawaki: column 9, lines 60-64). In view of the above disclosure, 
one of ordinary skill in the art at the time of the invention would have found it obvious 
that since B-frames require the most memory resources, the B-frames would be the 
frames that get skipped to free up access for the other frame types. 
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Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1-25 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Diaz et al. (US 5812789 A) in view of Miyawaki et al. (US 5752266 A). 

Re claim 1, Diaz discloses a video signal processing system for encoding an 
encoding bit stream according to characteristics of a decoding bit stream, the encoding 
and decoding bit streams include a plurality of encoding schemes, the video signal 
processing system comprising: a storage device utilized for storing data of the decoding 
bit stream and the encoding bit stream (Diaz: Fig. 2, memory 50); and an encoder 
electrically connected to the storage device for encoding the encoding bit stream 
according to an encoding scheme of the decoding bit stream (Diaz: Fig. 2, encoder 46), 
the memory bandwidth needed for a third encoding scheme out of the plurality of 
encoding schemes being greater than the memory bandwidth needed for any other 
encoding scheme out of the plurality of encoding schemes (Diaz: column 3, lines 26-39, 
some images are decoded based on previous images (P frames) and some images are 
decoded based previous and future images (B frames), wherein more memory 
bandwidth would be required for accessing two images as opposed to just one image) 
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Diaz does not specifically disclose the encoder encoding the encoding bit stream 
using one of the plurality of encoding schemes except the third encoding scheme when 
the encoding scheme of the decoding bit stream is the third encoding scheme. 
However, Miyawaki discloses a system and method of controlling memory access 
operations by changing respective priorities thereof, based on situation of the memory, 
wherein the memory control circuit may arbitrate and schedule the memory access 
operations of writing and reading the coded data and decoded image data to and from 
the dynamic random access memory as well as a memory access operation of 
refreshing the dynamic random access memory (Miyawaki: column 3, lines 22-26). 
Furthermore, Miyawaki discloses that the memory controller may change the priority of 
different data types (Miyawaki: column 3, lines 8-15), which one of ordinary skill in the 
art at the time of the invention would have found obvious to include various picture 
types (i.e., I-, P-, and B-frames) since the system disclosed by Miyawaki relates to 
processing MPEG data (Miyawaki: column 5, lines 25-32). Therefore, the lower priority 
operations (i.e., writing coded data to the memory) utilize the memory access bandwidth 
left-over from the higher priority operations (i.e., decoding coded data stored in the 
memory) by prioritizing the data which best fits into said left-over bandwidth. Since both 
Diaz and Miyawaki relate to controlling memory access for shared memory, one of 
ordinary skill in the art at the time of the invention would have found it obvious to 
combine the data prioritization of Miyawaki with the codec device of Diaz in order to 
realize an efficient memory system without increasing the capacity of a buffer or 



Application/Control Number: 1 0/71 1 ,1 39 Page 5 

Art Unit: 2621 

memory, the width of a memory bus, or an operating frequency (Miyawaki: Abstract 
section). 

Re claim 2, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 2, as discussed above in claim 1 . Additionally, Diaz discloses that 
the plurality of encoding schemes include three encoding schemes, and in addition to 
the third encoding scheme, the three encoding schemes further include a first encoding 
scheme and a second encoding scheme (Diaz: column 7, lines 16-22). 

Re claim 3, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 3, as discussed above in claim 2. Additionally, Diaz discloses that 
the memory bandwidth needed for the first encoding scheme is less than the memory 
bandwidth needed for the second encoding scheme, and the memory bandwidth 
needed for the second encoding scheme is less than the memory bandwidth needed for 
the third encoding scheme (Diaz: column 7, lines 16-22, intra coded images (I frames) 
do not require access to the stored images, so they use no memory bandwidth; column 
3, lines 26-39, some images are decoded based on previous images (P frames) and 
some images are decoded based previous and future images (B frames), wherein more 
memory bandwidth would be required for accessing two images as opposed to just one 
image). 

Re claim 4, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 4, as discussed above in claim 3. Additionally, Diaz discloses that 
the first, second, and third encoding schemes are the intra encoding, the predictive 
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encoding, and the bidirectionally predictive encoding, respectively (Diaz: column 7, lines 
16-22). 

Re claim 5, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 5, as discussed above in claim 4. Additionally, Diaz discloses that 
when the encoding scheme of the decoding bit stream is the intra encoding, the 
encoding scheme of the encoding bit stream is one of the intra encoding, the predictive 
encoding, and the bidirectionally predictive encoding (Diaz: column 8, lines 19-29, 
MPEG inherently utilizes one of intra, predicted, or bidirectionally predicted coding 
modes). 

Re claim 6, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 6, as discussed above in claim 4. Additionally, Diaz discloses that 
when the encoding scheme of the decoding bit stream is the predictive encoding, the 
encoding scheme of the encoding bit stream is one of the intra encoding, and the 
predictive encoding (Diaz: column 8, lines 19-29, MPEG inherently utilizes one of intra, 
predicted, or bidirectionally predicted coding modes; column 3, lines 26-39, dropping 
frames to reduce required memory bandwidth). 

Re claim 7, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 7, as discussed above in claim 4. Additionally, Diaz discloses that 
when the encoding scheme of the decoding bit stream is the bidirectionally predictive 
encoding, the encoding scheme of the encoding bit stream is the intra encoding (Diaz: 
column 8, lines 19-29, MPEG inherently utilizes one of intra, predicted, or bidirectionally 
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predicted coding modes; column 3, lines 26-39, dropping frames to reduce required 
memory bandwidth). 

Re claim 8, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 8, as discussed above in claim 1 . Additionally, Diaz discloses that 
the storage device is a memory (Diaz: Fig. 2, memory 50), and the video signal 
processing system further comprises a memory interface for controlling access to the 
memory (Diaz: Fig. 2, memory interface 48). 

Re claim 9, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 9, as discussed above in claim 1 . Additionally, Diaz discloses a 
decoder electrically connected to the storage device for decoding the decoding bit 
stream (Diaz: Fig. 2, decoder 44) and sending the encoding scheme of the decoding bit 
stream to the encoder (Diaz: column 8, lines 19- 29, the decoder/encoder is capable of 
utilizing multiple coding standards; column 6, lines 32-38, the type of coding standard 
factors into bandwidth calculations; column 6, lines 12-13, the DMA engine may be an 
integrated part of the decoder/encoder). 

Re claim 10, Diaz discloses a video signal encoding and decoding method for 
encoding an encoding bit stream according to characteristics of a decoding bit stream, 
the encoding and decoding bit streams include a plurality of encoding schemes, the 
video signal encoding and decoding method comprising: (a) checking an encoding 
scheme of the decoding bit stream to decide an encoding scheme for encoding the 
encoding bit stream (Diaz: column 8, lines 19-29, the decoder/encoder is capable of 
utilizing multiple coding standards; column 6, lines 32-38, the type of coding standard 
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factors into bandwidth calculations; column 6, lines 12-13, the DMA engine may be an 
integrated part of the decoder/encoder). 

Diaz discloses that intra coded images (I frames) do not require access to the 
stored images, so they use no memory bandwidth (column 7, lines 16-22) and some 
images are decoded based on previous images (P frames) and some images are 
decoded based previous and future images (B frames) (column 3, lines 26-39), wherein 
more memory bandwidth would be required for accessing two images as opposed to 
just one image, but Diaz does not specifically disclose encoding the encoding bit stream 
using one of the plurality of encoding schemes except a third encoding scheme when 
the encoding scheme of the decoding bit stream is the third encoding scheme, the 
memory bandwidth needed for the third encoding scheme being greater than the 
memory bandwidth needed for any other encoding scheme out of the plurality of 
encoding schemes. However, Miyawaki discloses a system and method of controlling 
memory access operations by changing respective priorities thereof, based on situation 
of the memory, wherein the memory control circuit may arbitrate and schedule the 
memory access operations of writing and reading the coded data and decoded image 
data to and from the dynamic random access memory as well as a memory access 
operation of refreshing the dynamic random access memory (Miyawaki: column 3, lines 
22-26). Furthermore, Miyawaki discloses that the memory controller may change the 
priority of different data types (Miyawaki: column 3, lines 8-15), which one of ordinary 
skill in the art at the time of the invention would have found obvious to include various 
picture types (i.e., I-, P-, and B-frames) since the system disclosed by Miyawaki relates 
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to processing MPEG data (Miyawaki: column 5, lines 25-32). Therefore, the lower 
priority operations (i.e., writing coded data to the memory) utilize the memory access 
bandwidth left-over from the higher priority operations (i.e., decoding coded data stored 
in the memory) by prioritizing the data which best fits into said left-over bandwidth. 
Since both Diaz and Miyawaki relate to controlling memory access for shared memory, 
one of ordinary skill in the art at the time of the invention would have found it obvious to 
combine the data prioritization of Miyawaki with the codec device of Diaz in order to 
realize an efficient memory system without increasing the capacity of a buffer or 
memory, the width of a memory bus, or an operating frequency (Miyawaki: Abstract 
section) 

Claim 11 has been analyzed and rejected with respect to claim 2 above. 

Claim 12 has been analyzed and rejected with respect to claim 3 above. 

Claim 13 has been analyzed and rejected with respect to claim 4 above. 

Claim 14 has been analyzed and rejected with respect to claim 5 above. 

Claim 15 has been analyzed and rejected with respect to claim 6 above. 

Claim 16 has been analyzed and rejected with respect to claim 7 above. 

Re claim 17, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 1 7, as discussed above in claim 1 0. Additionally, Diaz discloses 
that the decoding bit stream and the encoding bit stream are both accessed through the 
same memory interface circuit corresponding to a memory (Diaz: Fig. 2, decoder 44 and 
encoder 46 are both connected to memory 50 via the memory interface 48 and the DMA 
engine 52). 
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Re claim 18, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 1 8, as discussed above in claim 1 0. Additionally, Diaz discloses 
that the encoding bit Stream is an encoding bit stream corresponding to a picture (Diaz: 
Fig. 2, video decoding circuit 12 and video encoding circuit 62 process video data, 
which corresponds to sequences of pictures). 

Re claim 19, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 1 9, as discussed above in claim 1 0. Additionally, Diaz discloses 
that the encoding bit stream is an encoding bit stream corresponding to a blockof a 
picture (Diaz: column 8, lines 19-29, MPEG inherently provides for processing video in 
blocks of pixels). 

Re claim 20, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 20, as discussed above in claim 1 9. Additionally, Diaz discloses 
that the block is a macroblock (Diaz: column 8, lines 19-29, MPEG inherently provides 
for processing video in macroblOcks of 16X16 pixels). 

Claim 21 has been analyzed and rejected with respect to claim 5 above. 

Re claim 22, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 22, as discussed above in claim 21 . Additionally, Diaz discloses 
encoding the block according to the intra encoding when the encoding scheme of the 
picture is the intra encoding (Diaz: column 8, lines 19-29, MPEG inherently utilizes one 
of intra, predicted, .or bidirectionally predicted coding modes). 

Re claim 23, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 23, as discussed above in claim 21 . Additionally, Diaz discloses 
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encoding the block according to one of the intra encoding and the forward motion 
compensation encoding when the encoding scheme of the picture is the predictive 
encoding (Diaz: column 8, lines 19-29, MPEG inherently utilizes one of intra, predicted, 
or bidirectionally predicted coding modes). 

Re claim 24, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 24, as discussed above in claim 21 . Additionally, Diaz discloses 
encoding the block according to one of the intra encoding, the forward motion 
compensation encoding, the backward motion compensation encoding, and the 
bidirectional motion compensation encoding when the encoding scheme of the picture is 
the bidirectionally predictive encoding (Diaz: column 8, lines 19-29, MPEG inherently 
utilizes one of intra, predicted, or bidirectionally predicted coding modes). 

Re claim 25, the combined system of Diaz and Miyawaki discloses a majority of 
the features of claim 25, as discussed above in claim 21 . Additionally, Diaz discloses 
encoding the block according to one of the forward motion compensation encoding, the 
backward motion compensation encoding, and the bidirectional motion compensation 
encoding when the encoding scheme of the picture is the bidirectionally predictive 
encoding (Diaz: column 8, lines 19-29, MPEG inherently utilizes one of intra, predicted, 
or bidirectionally predicted coding modes). 

Re claim 26, Diaz discloses a real-time video processing method comprising: 
decoding a first bitstream that is encoded by a plurality of first encoding schemes to 
obtain a first current encoding scheme, each of the plurality of first encoding schemes 
consuming different amount of memory bandwidth of a memory (Diaz: Fig. 2, decoder 
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44 for decoding video and audio data); encoding a second bitstream with said memory 
and with a second current encoding scheme selected from one of a plurality of second 
encoding schemes while the first bitstream is decoded (Diaz: column 8, lines 19-29, 
MPEG inherently utilizes one of intra, predicted, or bidirectionally predicted coding 
modes). 

Diaz does not explicitly disclose that the second current encoding scheme is 
selected by choosing one second encoding scheme that consumes lower memory 
bandwidth of said memory if the first current encoding scheme indicates higher memory 
bandwidth of said memory being consumed so that the total necessary memory 
bandwidth of said memory shared by decoding the first bitstream and encoding the 
second bitstream is under maximum allowable bandwidth of the said memory during 
real-time video processing. However, Miyawaki discloses a system and method of 
controlling memory access operations by changing respective priorities thereof, based 
on situation of the memory, wherein the memory control circuit may arbitrate and 
schedule the memory access operations of writing and reading the coded data and 
decoded image data to and from the dynamic random access memory as well as a 
memory access operation of refreshing the dynamic random access memory (Miyawaki: 
column 3, lines 22-26). Furthermore, Miyawaki discloses that the memory controller 
may change the priority of different data types (Miyawaki: column 3, lines 8-15), which 
one of ordinary skill in the art at the time of the invention would have found obvious to 
include various picture types (i.e., I-, P-, and B-frames) since the system disclosed by 
Miyawaki relates to processing MPEG data (Miyawaki: column 5, lines 25-32). 
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Therefore, the lower priority operations (i.e., writing coded data to the memory) utilize 
the memory access bandwidth left-over from the higher priority operations (i.e., 
decoding coded data stored in the memory) by prioritizing the data which best fits into 
said left-over bandwidth. Since both Diaz and Miyawaki relate to controlling memory 
access for shared memory, one of ordinary skill in the art at the time of the invention 
would have found it obvious to combine the data prioritization of Miyawaki with the 
codec device of Diaz in order to realize an efficient memory system without increasing 
the capacity of a buffer or memory, the width of a memory bus, or an operating 
frequency (Miyawaki: Abstract section). 



Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure: 

a. Memory management for an MPEG2 compliant decoder; Cheney et al. 
(US 5668599 A) 

b. Methods and apparatus for processing luminance and chrominance image 
data; Pearlstein et al. (US 6385248 B1) 

c. System and method for adaptive video processing with coordinated 
resource allocation; Rodriguez et al. (US 20020009149 A1) 

d. Recording apparatus and coding apparatus; Fukuda et al. (US 6856759 
B1) 
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e. Moving image encoding method and apparatus, and moving image 
decoding method and apparatus; Kato (US 6415055 B1) 

Contact 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to CHRISTOPHER FINDLEY whose telephone number is 
(571)270-1199. The examiner can normally be reached on Monday-Friday (8:30 AM- 
5:00 PM). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Marsha D. Banks-Harold can be reached on 571-272-7905. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Marsha D. Banks-Harold/ 
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